System and method for assisting a visually impaired individual

ABSTRACT

A system and method for assisting a visually impaired individual are disclosed. In one embodiment, when the visually impaired individual encounters a situation with an obstacle, the visually impaired individual employs a first wireless device to transfer audiovisual information about the situation to an assistant with a second wireless device. The assistant analyzes the rendered audiovisual information and provides audio information to the visually impaired individual which presents a solution to the obstacle.

PRIORITY STATEMENT & CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority from co-pending U.S. patent applicationSer. No. 60/744,389, entitled “System and Method for Substantially RealTime Wireless Communication” and filed on Apr. 6, 2006, in the name ofDavid E. Espenlaub; which is hereby incorporated by reference for allpurposes.

TECHNICAL FIELD OF THE INVENTION

This invention relates, in general, to adaptive technologies forvisually impaired and blind individuals and, in particular, to a systemand method for assisting a visually impaired individual that utilizes awireless device to enable the visually impaired individual to completedaily activities utilizing their remaining senses.

BACKGROUND OF THE INVENTION

Visual impairment, compromised vision, and blindness may be a result ofdisease, genetic abnormalities, injuries, or age, for example. Visuallyimpaired individuals (including those individuals with compromisedvision and blindness) often use tactile or auditory feedback methods fornavigating movement within small confines as well as in open and lessfamiliar spaces. Adaptive technologies assist the visually impairedindividual in completing daily activities, such as navigating movement,utilizing their remaining senses. Existing electronic navigationaladaptive technologies rely on visual cues which are often unfamiliar andmay be misinterpreted by the electronic navigational device.Accordingly, there is a need for new and improved adaptive technologies.

SUMMARY OF THE INVENTION

A system and method for assisting a visually impaired individual aredisclosed. In one embodiment, when the visually impaired individualencounters a situation with an obstacle, the visually impairedindividual employs a first wireless device to transfer audiovisualinformation about the situation to an assistant with a second wirelessdevice. The assistant analyzes the rendered audiovisual information andprovides audio information to the visually impaired individual whichpresents a solution to the obstacle. Utilizing this system and method,the assistant may be a remotely-located, non-specialist withoutoccupational devotion to assisting visually impaired individuals.Further, the assistance does not have to be prearranged and theassistant is not required to be located at a special service center orwithin any proximity to the visually impaired individual.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the features and advantages of thepresent invention, reference is now made to the detailed description ofthe invention along with the accompanying figures in which correspondingnumerals in the different figures refer to corresponding parts and inwhich:

FIG. 1 is a schematic diagram of one embodiment of a system forassisting a visually impaired individual;

FIG. 2 is a functional block diagram depicting one embodiment of theadaptive technology of FIG. 1 in further detail;

FIG. 3 is a flow chart depicting one embodiment of a method forassisting a visually impaired individual; and

FIG. 4 is a flow chart depicting another embodiment of a method forassisting a visually impaired individual.

DETAILED DESCRIPTION OF THE INVENTION

While the making and using of various embodiments of the presentinvention are discussed in detail below, it should be appreciated thatthe present invention provides many applicable inventive concepts whichcan be embodied in a wide variety of specific contexts. The specificembodiments discussed herein are merely illustrative of specific ways tomake and use the invention, and do not delimit the scope of the presentinvention.

Referring initially to FIG. 1, therein is depicted one embodiment of asystem 10 for assisting a visually impaired individual 12 when asituation 14 is encountered having an obstacle 16. As depicted, thesituation 14 is an unfamiliar intersection and the obstacle 16 iscrossing the unfamiliar intersection. It should be appreciated, however,that the situation 14 and obstacle 16 may be any hindrance or impedimentthat interferes, restricts, or prevents action by the visually impairedindividual.

A long white cane 18, the international symbol of blindness, is employedby the visually impaired individual 12 to extend the range of touchsensation of the individual. Swung in a low sweeping motion across theintended path of travel, the long white cane 18 enables the visuallyimpaired individual to detect obstacles. It should be appreciated thatalthough a long white cane 18 is depicted, the visually impairedindividual 12 may employ other adaptive technologies, such as a lighteridentification cane, support cane, or guide dog, for example, to assistin navigation.

With respect to the particular situation 14 and unfamiliar intersection,the long white cane 18 is an insufficient adaptive technology for thevisually impaired individual 12 to negotiate or navigate the obstacle16. Similarly, existing electronic navigational adaptive technologiesare also inadequate for negotiating the obstacle 16 as these adaptivetechnologies rely on visual cues of an unfamiliar intersection and aremisinterpreted by the electronic navigational device. To navigate theobstacle 16, the visually impaired individual 12 employs a wirelessdevice 20 to transfer audiovisual information about the situation 14 toa potential assistant 22 with a wireless device 24 or, alternatively, ifthe potential assistant 22 is not available to another potentialassistant, such as potential assistant 26 with a wireless device 28. Thepotential assistants 22, 26 may be remotely located to the visuallyimpaired individual 12 and a prearrangement of assistance is notrequired, i.e., the assistance may be substantially spontaneous. By wayof example, once a communication circuit is established between thewireless devices 20 and 24 of the visually impaired individual 12 andthe assistant 22, respectively, as represented by communication signal30, the visually impaired individual 12 transfers audiovisualinformation about the situation 14 and the obstacle 16 to the assistant22. The assistant 22 is then able to analyze the transferred informationand provide audio information to the visually impaired individual 12which presents a solution to the obstacle 16. In one implementation,substantially realtime, continuous video communication is provided bythe wireless device 20 of the visually impaired individual 12 to thewireless device 24 of the assistant 22. Accordingly, the sited assistant22 is provided with realtime, continuous video images as a basis forvisual interpretation and analysis of the situation 14. Person-to-personor personalized navigational assistance, which may be remote andsubstantially spontaneous, is thereby provided over a wireless network.

By utilizing wireless devices belonging to the visually impairedindividual 12 and any potential assistant, the teachings presentedherein enable a visually impaired individual 12 to receive assistancewithout the need for a call center or other type of assistance centerthat may require a membership, a fee, or may be insufficiently staffed.Accordingly, the assistant may be a non-specialist without occupationaldevotion to assisting visually impaired individuals. By way of example,the assistant may be a friend, co-worker, acquaintance, or family memberproviding substantially spontaneous assistance while being engaged inday-to-day activities prior to the communication from the visuallyimpaired individual. The assistant may be providing the assistanceremotely to the visually impaired individual and away from any callcenter or other specialized support facility whether or not theassistance was prearranged. Further, in embodiments where wirelessdevices such as cellular telephones are used, the assistance does nothave to be prearranged and the assistant is not required to be locatedat a special service center. Although in the illustrated embodiment, theassistant is not located at a call center or service center, it shouldbe appreciated that such an application is within the teachingspresented herein.

FIG. 2 depicts one embodiment of the adaptive technology of FIG. 1 infurther detail. The wireless device 20 may include a microcontroller (ormicroprocessor) 40, an antenna 42, a display 44, a power source 46,interfaces 48 such as a Bluetooth® interface or USB port, a speaker 50,a microphone 52, a video camera 54, and a GPS unit 56. Likewise, thewireless device 24 may include a microcontroller 60, an antenna 62, adisplay 64, a power source 66, interfaces 68, a speaker 70, a microphone72, a video camera 74, and a GPS unit 76. Each of the wireless devices20 and 24 may include cellular telephones, personal digital assistants(PDAs) or other electronic communication devices, for example, thatpermit communication between two individuals. By way of further example,each wireless device may be a wireless, high resolution video and audiocollaboration device that is specialized to transmit video and audiocontent between the visually impaired individual and the assistant.

Additionally, although particular architectures are illustrated for eachwireless device, it should be appreciated that each wireless device maycomprise any architecture having any combination of hardware, software,and firmware. Moreover, it should be appreciated that the wirelessdevice 20 does not require a display 44, interfaces 48, or a GPS unit56, for example. Similarly, the wireless device 24 does not requireinterfaces 68, the video camera 74, or the GPS unit 76. In particular,in one implementation, the wireless device 24 only requires the display64, the speaker 70, and the microphone 72. Further, a wired-device,which would not include the antenna 62, such as a computer connected tothe Internet, for example, may be utilized instead of the wirelessdevice 24. The wired-device embodiment is particularly appropriate for acall center service embodiment, whether subscription-based or a freepublic service, having ready occupational professionals to assist thevisually impaired individual.

In operation, a wireless network provides for communication between thewireless devices 20 and 24. The wireless network may be atelecommunications network, cellular network, or a Wi-Fi network, forexample, and may vary in accordance with the selected wireless devices.The wireless devices enable the transmission of audiovisual data fromthe wireless device 20 to the wireless device 24 and the transmission ofaudio data from the wireless device 24 to the wireless device 20. In oneembodiment, to enable the receipt and rendering of high quality videoand audio at wireless device 24, at least a portion of the transmitteddata is compressed and later decompressed by a compression scheme. Thevideo camera 54 may be a high resolution, auto focus camera with asoftware application that includes features to enable the encoding,compression, and transmission of the video from the wireless device 20to the wireless device 24 over the selected communication channel. Thecompression algorithms may be efficient and provide for the use of theavailable bandwidth during the communication without compromising thequality of the video images. Similarly, the wireless device 24 includessoftware for efficiently decoding, decompressing, and rendering thereceived video images, which may comprise, over a period of time,substantially realtime, continuous video.

In one implementation, the wireless device 20 captures video images atvideo camera 54 and compresses the video images at microcontroller 40via a software application installed therein prior to transmitting thevideo to wireless device 24. In another implementation, audiovisual datais captured by the video camera 54 and microphone 52 and both arecompressed prior to transmission as represented by number 78. Once thedata is received at wireless device 24, the data is appropriatelydecompressed by a software package installed on the microcontroller 60.The video images may then be displayed on the display 64 and the audiorendered by the speaker 70. In response to the received communication,the wireless device 24 may capture audio at the microphone 72 and send,as indicated by number 80, the captured audio to the wireless device 20for rendering by speaker 50. The audio captured by the wireless device24 may or may not be compressed and decompressed.

FIG. 3 depicts one embodiment of a method for assisting a visuallyimpaired individual. At block 90, the visually impaired individualencounters a situation with an obstacle. At block 92, the visuallyimpaired individual's wireless device is utilized to capture audiovisualinformation relating to the situation and the obstacle. At this time,the audiovisual information, or the visual component of the audiovisualinformation, may be encoded and/or compressed. At block 94, the capturedaudiovisual information is relayed to a wireless device belonging to anassistant. Furthermore at blocks 92 and 94, the GPS coordinates of thevisually impaired individual may be read by a GPS unit integrated withthe wireless device and transmitted with or at substantially the sametime as the captured audiovisual information. It should be understoodthat the GPS coordinates may be utilized by the assistant to locate thelocation of the visually impaired individual and therefore provideinformation to the visually impaired individual which is based onadditional data. Once received, the encoded, compressed components ofthe captured audiovisual information may be decoded and decompressed.

At block 96, the captured audiovisual information is rendered at thewireless device belonging to the assistant. At block 98, the assistantanalyzes the rendered audiovisual information and provides informationin the form of an audible response which is captured as audioinformation at block 100. At block 102, the captured audio informationis relayed from the wireless device of the assistant to the wirelessdevice of the visually impaired individual. At block 104, the audioinformation is rendered and the assistant's analysis assists thevisually impaired person with overcoming the obstacle in the situation.

FIG. 4 depicts another embodiment of a method for assisting a visuallyimpaired individual. At block 110, a visually impaired individualencounters a situation having an obstacle. The visually impairedindividual is unable to negotiate or navigate the obstacle utilizingexisting senses and any adaptive technology. At block 112, the visuallyimpaired individual decides third-party assistance, which may be remoteand substantially spontaneous, is required via the adaptive technologydiscussed herein. At block 114, the visually impaired individual uses awireless device to capture visual and audio data about the situation andobstacle.

In one implementation, the systems and methodologies presented hereininclude a presence information feature whereby a status indicator on thewireless device of the visually impaired individual conveysavailability, ability, and willingness of a potential assistant toassist the visually impaired individual. In one operational embodiment,the functionality of the presence information is enabled by softwareinstalled on each wireless device and/or a remote server integrated withor disposed in communication with the wireless network that providescommunication between the wireless devices of the visually impairedindividual and the assistant. Such a service, which may incorporate apolling function that regularly updates the status of individuals, maybe enabled by a Global System for Mobile Communications (GSM)—basedprotocol or similar wireless protocol.

Common states of an individual include “no assistance required”,“assistance required”, and “thank you, being assisted”. Common states ofthe potential assistants include “free to help”, “busy”, and “away”, forexample. It should be appreciated, however, that other states arepossible for both the visually impaired individual and potentialassistants that support a rich choice of additional presence attributes.

Returning to decision block 116 in FIG. 4, if the presence informationfunctionality is enabled, then the methodology advances to blocks 118and 120 wherein an assistant is selected from a group of potentialassistants and a communication circuit is established between thewireless device of the visually impaired individual and a wirelessdevice belonging to the assistant. Once this the communication circuitis established, the method continues to decision block 122.

Returning to decision block 116, however, if the presence informationfeature is not implemented or not available, then the methodologycontinues from block 116 to block 124, wherein the visually impairedindividual selects a potential assistant and, at block 126, establishesa communication circuit with the potential circuit. At decision block128, if the potential assistant is available, then the methodologyadvances to decision block 122. Otherwise, the methodology returns toblock 124 so that another potential assistant may be selected andcontacted by the visually impaired individual. In one implementation,the enablement of presence information at decision block 116 and theassociated options of blocks 118 through 120 and blocks 124 through 128respectfully represent automated and ad hoc approaches the visuallyimpaired individual may employ to find assistance. One embodiment of theautomated approach is depicted with blocks 118 through 120. In anotherembodiment, the automated approach may include calling a dedicatedservice center or other prearranged alternative for assistance.

At decision block 122, if full teleconferencing functionality isavailable on the wireless device of the assistant, then the processadvances to block 130 wherein duplexed audio communication is providedbetween the visually impaired individual and the assistant. In oneimplementation, the duplexed audio communication may include compressionand decompression and/or encoding and decoding of the transferred data.Additionally, a substantially continuous feed of visual data is providedfrom the wireless device of the visually impaired individual to thewireless device of the assistant. With two-way audio communicationenabled and the assistant receiving visual data of the visually impairedindividual's environment, at block 132, the assistant is able to providethe visually impaired individual with assistance.

Returning to decision block 122, if the wireless device of the assistantis not able to receive real time video while supporting duplexed audiocommunication, then a video clip, which may include or comprise a stillimage, is transferred from the visually impaired individual to theassistant at block 134. At block 136, duplexed audio communication isprovided between the visually impaired individual and the assistant.Additionally, the video clip is rendered. It should be appreciated thatthe rendering of the video clip may occur prior to the duplexed audiocommunication. Further, compression and decompression may occur as partof the transmission of the data and, in particular, the video portion ofthe data. Alternatively, with respect to blocks 134 and 136, the videoclip may be rendered in substantially real time prior to the duplexedaudio communications occurring. Once the video clip is viewed and thevisually impaired individual and assistant are able to verballycommunicate, as previously discussed, the visually impaired individualis assisted at block 132. It should be appreciated that the order of themethodologies presented in FIGS. 3 and 4 may vary. By way of example,the operations of block 114 may occur after the operations of blocks 116through 128.

While this invention has been described with reference to illustrativeembodiments, this description is not intended to be construed in alimiting sense. Various modifications and combinations of theillustrative embodiments as well as other embodiments of the invention,will be apparent to persons skilled in the art upon reference to thedescription. It is, therefore, intended that the appended claimsencompass any such modifications or embodiments.

What is claimed is:
 1. A method for assisting a visually impairedindividual, the method comprising: encountering a situation with anobstacle; capturing audiovisual information at a first wireless devicebelonging to the visually impaired individual, the audiovisualinformation relating to the situation; relaying the captured audiovisualinformation from the first wireless device to a second wireless devicebelonging to an assistant, the assistant being a non-specialist withoutoccupational devotion to assisting visually impaired individuals;rendering the captured audiovisual information at the second wirelessdevice; performing an analysis of the rendered audiovisual information;capturing audio information at the second wireless device, the audioinformation relating to a solution to the obstacle; relaying thecaptured audio information from the second wireless device to the firstwireless device; and rendering the captured audio information at thefirst wireless device, thereby assisting the visually impaired personwith the obstacle.
 2. The method as recited in claim 1, furthercomprising: compressing the captured audiovisual information at thefirst wireless device prior to relaying the captured audiovisualinformation; and decompressing the compressed audiovisual information atthe second wireless device after receiving the compressed audiovisualinformation at the second wireless device.
 3. The method as recited inclaim 1, wherein relaying the captured audiovisual information furthercomprises utilizing a wireless network for the relay.
 4. A method forassisting a visually impaired individual, the method comprising:encountering a situation with an obstacle; monitoring presenceinformation of a plurality of potential assistants, each of theplurality of assistants being a non-specialist without occupationaldevotion to assisting visually impaired individuals; selecting one ofthe plurality of potential assistants to call based on the presenceinformation; establishing a communication circuit between a firstwireless device associated with the visually impaired individual and asecond wireless device associated with the selected assistant;transmitting a substantially continuous, realtime visual feed from thefirst wireless device to the second wireless device; and duplexing audiocommunication between the first wireless device and the second wirelessdevice, the audio communication including a verbal solution toovercoming the obstacle.
 5. The method as recited in claim 4, furthercomprising: compressing the substantially continuous, realtime visualfeed prior to transmission from the first wireless device; anddecompressing the substantially continuous, realtime visual feed at thesecond wireless device.
 6. The method as recited in claim 4, whereintransmitting the substantially continuous, realtime visual feed furthercomprises utilizing a cellular network.
 7. The method as recited inclaim 4, wherein monitoring presence information further comprisesanalyzing the availability, ability, and willingness of each of theplurality of potential assistants to assist the visually impairedindividual.
 8. A system for assisting a visually impaired individual,the system comprising: a first wireless device for polling a pluralityof potential assistants in response to encountering an obstacle in asituation, each of the plurality of potential assistants being anon-specialist without occupational devotion to assisting visuallyimpaired individuals; means for determining availability status of theplurality of potential assistants; means for selecting one of theplurality of potential assistants to call; means for establishing acommunication circuit between the first wireless device associated withthe visually impaired individual and a second wireless device associatedwith the selected assistant; means for sending a substantiallycontinuous, realtime visual feed from the first wireless device to thesecond wireless device; and means for duplexing audio communicationbetween the first wireless device and the second wireless device, theaudio communication including a verbal solution to overcoming theobstacle.
 9. The system as recited in claim 8, further comprising acellular network for enabling communication between the first wirelessdevice and the second wireless device.
 10. The system as recited inclaim 8, wherein the first wireless device further comprises a cellulartelephone.
 11. The system as recited in claim 8, further comprising:means for compressing the substantially continuous, realtime visual feedat the first wireless device; and means for decompressing the compressedsubstantially continuous visual feed at the second wireless device. 12.The system as recited in claim 8, wherein the first wireless device isat least partially integrated with a component selected from the groupconsisting of the means for determining availability, the means forestablishing a communication circuit, the means for sending asubstantially continuous, realtime visual feed, and means for duplexingaudio communication.